Hamilton-Jacobi-Bellman equations for Quantum Optimal Feedback Control
نویسنده
چکیده
We exploit the separation of the ltering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman equations using the elementary arguments of classical control theory and show that this is equivalent, in the Stratonovich calculus, to a stochastic Hamilton-Pontryagin setup. We show that, for cost functionals that are linear in the state, the theory yields the traditional Bellman equations treated so far in quantum feedback. A controlled qubit with a feedback is considered as example.
منابع مشابه
Hamilton-Jacobi-Bellman equations for Quantum Filtering and Control
We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman equations using the elementary arguments of classical control theory and show that this is equivalent, in the Stratonovich calculus, to a stochastic Hamilto...
متن کاملOn the dynamic programming approach for the 3D Navier-Stokes equations
The dynamic programming approach for the control of a 3D flow governed by the stochastic Navier-Stokes equations for incompressible fluid in a bounded domain is studied. By a compactness argument, existence of solutions for the associated Hamilton-Jacobi-Bellman equation is proved. Finally, existence of an optimal control through the feedback formula and of an optimal state is discussed.
متن کاملBellman Equations Associated to The Optimal Feedback Control of Stochastic Navier-Stokes Equations
We study the infinite dimensional second-order Hamilton-Jacobi-Bellman equations associated to the feedback synthesis of stochastic Navier-Stokes equation forced by space-time white noise. Uniqueness of viscosity solutions and short-time existence are proven for these infinite dimensional partial differential equations.
متن کاملStochastic Optimal Control of Delay Equations Arising in Advertising Models
We consider a class of optimal control problems of stochastic delay differential equations (SDDE) that arise in connection with optimal advertising under uncertainty for the introduction of a new product to the market, generalizing classical work of Nerlove and Arrow [30]. In particular, we deal with controlled SDDE where the delay enters both the state and the control. Following ideas of Vinte...
متن کاملOptimal Feedback Control for Undamped Wave Equations by Solving a Hjb Equation
An optimal finite-time horizon feedback control problem for (semi-linear) wave equations is presented. The feedback law can be derived from the dynamic programming principle and requires to solve the evolutionary Hamilton-Jacobi-Bellman (HJB) equation. Classical discretization methods based on finite elements lead to approximated problems governed by ODEs in high dimensional spaces which makes ...
متن کامل